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Many natural and social systems develop complex networks, that are usually modelled as random 
graphs. The eigenvalue spectrum of these graphs provides information about their structural prop- 
erties. While the semi-circle law is known to describe the spectral density of uncorrelated random 
graphs, much less is known about the eigenvalues of real-world graphs, describing such complex 
systems as the Internet, metabolic pathways, networks of power stations, scientific collaborations 
or movie actors, which are inherently correlated and usually very sparse. An important limitation 
in addressing the spectra of these systems is that the numerical determination of the spectra for 
systems with more than a few thousand nodes is prohibitively time and memory consuming. Making 
use of recent advances in algorithms for spectral characterization, here we develop new methods to 
determine the eigenvalues of networks comparable in size to real systems, obtaining several surpris- 
ing results on the spectra of adjacency matrices corresponding to models of real-world graphs. We 
find that when the number of links grows as the number of nodes, the spectral density of uncorre- 
lated random graphs does not converge to the semi-circle law. Furthermore, the spectral densities 
of real-world graphs have specific features depending on the details of the corresponding models. 
In particular, scale-free graphs develop a triangle-like spectral density with a power law tail, while 
small- world graphs have a complex spectral density function consisting of several sharp peaks. These 
and further results indicate that the spectra of correlated graphs represent a practical tool for graph 
classification and can provide useful insight into the relevant structural properties of real networks. 



I. INTRODUCTION 

Random graphs ||l|,^ have long been used for modelling 
the evolution and topology of systems made up of large 
assemblies of similar units. The uncorrelated random 
graph model - which assumes each pair of the graph's ver- 
tices to be connected with equal and independent prob- 
abilities - treats a network as an assembly of equivalent 
units. This model, introduced by the mathematicians 
Paul Erdos and Alfred Renyi [|l[, has been much inves- 
tigated in the mathematical literature [1). However, the 
increasing availability of large maps of real-life networks 
has indicated that real networks are fundamentally corre- 
lated systems, and in many respects their topology devi- 
ates from the uncorrelated random graph model. Conse- 
quently, the attention has shifted towards more advanced 
graph models which are designed to generate topologies in 
line with the existing empirical results p|-p^. Examples 
of real networks, that serve as a benchmark for the cur- 
rent modelling efforts include the Internet [|6|JT^-[r^, the 
World-Wide Web |^,|l^ , networks of collaborating movie 
actors and those of collaborating scientists ||l^,|l^, the 
power grid and the metabolic network of numerous 
living organisms [^,0 . 

These are the systems that we will call "real-world" 
networks or graphs. Several converging reasons explain 
the enhanced current interest in such real graphs. First, 
the amount of topological data available on such large 
structures has increased dramatically during the past few 
years thanks to the computerization of data collection 



in various fields, from sociology to biology. Second, the 
hitherto unseen speed of growth of some of these complex 
networks - e.g., the Internet - and their pervasiveness in 
affecting many aspects of our life has created the need 
to understand the topology, origin and evolution of such 
structures. Finally, the increased computational power 
available on almost every desktop has allowed, for the 
first time, to study such systems in unprecedented de- 
tail. 

The proliferation of data has lead to a flurry of activ- 
ity towards understanding the general properties of real 
networks. These efforts have resulted in the introduction 
of two classes of models, commonly called small-world 

T0|.|Tli. The first 



graphs [^y^l and the scale-free networks 
aims to capture the clustering observed in real graphs, 
while the second reproduces the power law degree dis- 
tribution present in many real networks. However, until 
now, most analyses of these models and data sets have 
been confined to real-space characteristics, that capture 
their static structural properties: e.g., degree sequences, 
shortest connecting paths and clustering coefficients. In 
contrast, there is extensive literature demonstrating that 
the properties of graphs and the associated adjacency 
matrices are well characterized by spectral methods, that 
provide global measures of the network properties ||l9|,^ . 
In this paper, we offer a detailed analysis of the most 
studied network models using algebraic tools intrinsic to 
large random graphs. 

The paper is organized as follows. Section^ introduces 
the main random graph models used for the topological 



description of large assemblies of connected units. Sec- 
tion [II lists the - analytical and numerical - tools which 



we used and developed to convert the topological features 



of graphs into algebraic invariants. Section IV contains 
our results concerning the spectra and special eigenvalues 
of the three main types of random gra ph m odels: sparse 
uncorrelated rand om gr aphs in Section IV A ; small- world 
graphs in Section 
tion IV C . Section 



IV B|; and scale-free networks in Sec- 



IV D gives simple al gorith ms for test- 
ing the graph 's structure, and Section IV E investigates 
the variance of structure within single random graph 
models. 



II. MODELS OF RANDOM GRAPHS 

A. The uncorrelated random graph model and the 
semi-circle law 



mechanical systems lying far beyond the reach of exact 
methods Later, the semi-circle law was found to 

have many applications in statistical physics and solid- 
state physics as well |l9| , ^ , ^ . 

Note, that for the adjacency matrix of the uncorrelated 
random graph many of the semi-circle law's conditions 
do not hold, e.g., the expectation value of the entries is 
a non-zero constant: p 0- Nevertheless, in the — > oo 
limit, the rescaled spectral density of the uncorrelated ran- 
dom graph converges to the semi-circle law otEq. (|^) [p6| . 
An illustration of the convergence of the average spectral 
density to the semi-circular distribution can be seen on 
Fig. ^ It is necessary to make a comment concerning fig- 
ures here. In order to keep figures simple, for the spectral 
density plots we have chosen to show the spectral density 
of the original matrix, A, and to rescale the horizontal 
(A) and vertical (p) axes by a^'^N^'^^'^ = [Np{l -p)]"^/^ 
and crAri/2 = [A^p(l -p)]i/2. 



1. Definitions 

Throughout this paper, we will use the term "graph" 
for a set of points (vertices) connected by undirected lines 
(edges) ; no multiple edges and no loops connecting a ver- 
tex to itself are allowed. We will call two vertices of 
the graph "neighbors", if they are connected by an edge. 
Based on Ref. H, we shall use the term "uncorrelated 
random graph" for a graph, if (i) the probability for any 
pair of the graph's vertices being connected is the same, 
p; (ii) these probabilities are independent variables. 

Any graph G can be represented by its adjacency ma- 
trix, A{G), which is a real symmetric matrix: Aij = 
Aji = 1, if vertices i and j are connected, or 0, if these 
two vertices are not connected. The main algebraic tool 
which we will use for the analysis of graphs will be the 
spectrum - i.e., the set of eigenvalues - of the graph's ad- 
jacency matrix. The spectrum of the graph's adjacency 
matrix is also called the spectrum of the graph. 



2. Applying the semi-circle law for the spectrum of the 
uncorrelated random graph 

A general form of the semi-circle law for real symmetric 
matrices is the following 1 19 2^j2^ . If A is a real symmet- 

; and 



vie N X N uncorrelated random matrix, {Ai 



{A 



a for every i ^ j, and with increasing N each 



moment of each \ Aij \ remains finite, then in the A^ — > oo 
limit the spectral density - i.e., the density of eigenvalues 
- of A/\/N converges to the semi-circular distribution: 



J (2^(72)-V4a2 - A2, 
0, 



if |A| < 2a; 
otherwise. 



(1) 



This theorem is also known as Wigner's law |gl|, and 
its extensions to further matrix ensembles have long been 
used for the stochastic treatment of complex quantum 




\/VNpi^ 



FIG. 1. If A'' ^ oo and p = const, the average spec- 
tral density of an uncorrelated random graph converges to a 
semi-circle, the first eigenvalue gro ws a s A'^, and the second 
is proportional to \/iV (see Section [I A). Main panel: The 
spectral density is shown for p = 0.05 and three different sys- 
tem sizes: N = 100 (— ), A^ = 300 (- -) and A^ = 1000 (---). 
In all three cases, the complete spectrum of 1000 graphs was 
computed and average d. Inset: A t the edge of the semi-circle 
- i.e., in the A « ±2-^ A''p(l — p) regions, - the spectral den- 
sity decays exponentially, and with A' — > oo, the decay rate 
diverges Here, F{\) = A^"^ I]a <a ^ ^^e cumula- 

tive spectral distribution function, and 1 — _F is shown for a 
graph with A' = 3, 000 vertices and 15, 000 edges. 

Some further results on the behavior of the uncor- 
related random graph's eigenvalues, relevant for the 
analysis of real-world graphs as well, include the fol- 
lowing: The principal eigenvalue (the largest eigen- 
value, Ai) grows much faster than the second eigenvalue: 
ImiN^aoi^i/N) = p with probability 1, whereas for ev- 
ery e > 1/2, limAr^oo(A2/A^") = 0. (see Refs. and 
Fig. ^). A similar relation holds for the smallest eigen- 
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value, Xn- for every e > 1/2, limjv^oo(AAr/-/V'^) = 0. 
In other words: if (ki) denotes the average number of 
connections of a vertex in the graph, then Ai scales as 
pN « (ki), and the width of the "bulk" part of the spec- 
trum ~ the set of the eigenvalues {X2, Xn} - scales as 
a\/N. Lastly, the semi-circular distribution's edges are 
known to decay exponentially, and the number of eigen- 
values in the A > 0{^fN) tail has been shown to be of 
the order of 1 [[ 



drops dramatically below L(pr = 0), whereas (ii) the av- 
erage clustering coefficient, C(pr), remains high, close to 
C(pr — 0). Note, that the rewiring procedure is carried 
out independently for every edge, therefore the degree se- 
quence and also other distributions in the system - e.g., 
path length and loop size - decay exponentially. 



2. The scale-free model 



B. Real- world graphs 

The two main models proposed to describe real-world 
graphs are the small-world model and the scale-free 
model. 



1. Small-world graphs 



The scale-free model assumes a random graph to be 
a growing set of vertices and edges, where the location 
of new edges is determined by a preferential attachment 
rule 1 10 O]. Starting from an initial set of mg isolated 
vertices, one adds 1 new vertex and m new edges at ev- 
ery time step t. (Throughout this paper, we will use 
m = rriQ.) The m new edges connect the new vertex and 
m different vertices chosen from the N old vertices. The 
ith old vertex is chosen with probability ki/ J2j=i n ' 
where ki is the degree of vertex i. (The density of edges 
in a scale-free graph is p = {ki)/{N — 1) « 2m/N.) In 
contrast to the small- world model, the distribution of de- 
grees in a scale- free graph converges to a power-law when 
N ^ 00, which has been shown to be a combined effect 
of growth and the preferential attachment lITTI] . Thus, in 
the infinite time or size limit, the scale-free model has no 
characteristic scale in the degree size ||l^ , ^ -p6| . 



The small-world graph [t4y5|j29f| is created by randomly 
rewiring some of the edges of a regular [ pO[ ring graph. 
The regular ring graph is created as follows. First draw 
the vertices 1, 2, N on a circle in ascending order. 
Then, for every i, connect vertex i to the vertices lying 
closest to it on the circle: vertices i—k/2, i— 1, i-\-l, 
i -\- k/2, where every number should be understood mod- 
ulo N [k is an even number). Fig.|| shows, that this algo- 
rithm creates a regular graph indeed, because the degree 
po| of any vertex is the same number, k. Next, starting 
from vertex 1 and proceeding towards iV, perform the 
rewiring step. For vertex 1, consider the first "forward 
connection", i.e., the connection to vertex 2. With proba- 
bility Pi-, reconnect vertex 1 to another vertex chosen uni- 
formly at random and without allowing multiple edges. 
Proceed towards the remaining forward connections of 
vertex 1, and then, perform this step for the remaining 

— 1 vertices also. For the rewiring, use equal and in- 
dependent probabilities. Note, that in the small-world 
model the density of edges is p = {ki) /{N — 1) « k/N. 
Throughout this paper, we will use only k > 2. 

If we use pr = in the small-world model, the original 
regular graph is preserved, and for p^ — 1, one obtains 
a random graph which differs from the uncorrelated ran- 
dom graph only slightly: every vertex has a minimum de- 
gree of k/2. Next, we will need two definitions. The sep- 
aration between vertices i and j - denoted by - is the 
number of edges in the shortest path connecting them. 
The clustering coefficient at vertex i - denoted by Ci - 
is the number of existing edges among the neighbors of 
vertex i divided by the number of all possible connections 

between them. In the small-world model, both Ly and to studies of scientific collaboration networks 
Ci are functions of the rewiring probability, pi-. Based on 
the above definitions of Ly (pr) and Ci(pr), the character- 
istics of the small-world phenomenon - which occurs for 
intermediate values of Pr - can be given as follows 
(i) the average separation between two vertices, i( 



3. Related models 



Lately, numerous other models have been sug- 
gested for a unified description of real-world graphs 
[|l^ , ^ll - |34|j3^ -|39t] . Models of growing networks with aging 
vertices were found to display both heavy tailed and ex- 
ponentially decaying degree sequences |p3|-^ as a func- 
tion of the speed of aging. Generalized preferential at- 
tachment rules have helped us better understand the ori- 
gin of the exponents and correlations emerging in these 
systems ||3^,^. Also, investigations of more complex 
network models - using aging or an additional fixed cost 
of edges |lj] or preferential growth and random rewiring 
p6| - have shown, that in the "frequent rewiring, fast 
aging, high cost" limiting case, one obtains a graph with 
an exponentially decaying degree sequence, whereas in 
the "no rewiring, no aging, zero cost" limiting case the 
degree sequence will decay as a power-law. According 

SUlil and 



further social and biological structures |12 5lfeL]|, a sig- 
nificant proportion of large networks lies between the two 
extremes. In such cases, the characterization of the sys- 
tem using a small number of algebraic constants could 
facilitate the classification of real-world networks. 
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III. TOOLS 
A. Analytical 

1. The spectrum of the graph 

The spectrum of a graph is the set of eigenvalues of 
the graph's adjacency matrix. The physical meaning of 
a graph's eigenpair (an eigenvector and its eigenvalue) 
can be illustrated by the following example. Write each 
component of a vector v on the corresponding vertex of 
the graph: Vi on vertex i. Next, on every vertex write 
the sum of the numbers found on the neighbors of ver- 
tex i. If the resulting vector is a multiple of u, then v 
is an eigenvector, and the multiplier is the corresponding 
eigenvalue of the graph. 

The spectral density of a graph is the density of the 
eigenvalues of its adjacency matrix. For a finite system, 
this can be written as a sum of delta functions 

1 ^ 

pW---j;^J2^(^-^^)^ (2) 

which converges to a continuous function with N —i- oo 
{Xj is the jth largest eigenvalue of the graph's adjacency 
matrix) . 

The spectral density of a graph can be directly related 
to the graph's topological features: the fcth moment, Mk, 
of p{X) can be written as 

1 ^ 1 
^^^ = ]^E(^.)' = ]^Tr(A')- 
i=i 

From the topological point of view, Dk = NMk is the 
number of directed paths (loops) of the underlying - undi- 
rected - graph, that return to their starting vertex after 
k steps. On a tree, the length of any such path can be 
an even number only, because these paths contain any 
edge an even number of times: once such a path has left 
its starting point by chosing a starting edge, no alterna- 
tive route for returning to the starting point is available. 
However, if the graph contains loops of odd length, the 
path length can be an odd number, as well. 



2. Extremal eigenvalues 

In an uncorrelated random graph the principal eigen- 
value, Ai, shows the density of edges and A2 can be re- 
lated to the conductance of the graph as a network of 
resistances An important property of all graphs is 
the following: the principal eigenvector, ei, of the ad- 
jacency matrix is a non-negative vector (all components 



are non-negative), and if the graph has no isolated ver- 
tices, 6*1 is a positive vector |4^. All other eigenvectors 
are orthogonal to ei , therefore they all have entries with 
mixed signs. 

3. The inverse participation ratios of eigenvectors 

The inverse participation ratio of the normalized jth 
eigenvector, Cj, is defined as |^ 

N 

^.-E[(^.-)fc]'- (4) 

k=l 

If the components of an eigenvector are identical - 
{ej)i = 1/VN for every i, - then Ij = 1/N. For an eigen- 
vector with one single non-zero component - {ej)i — Siji 
- the inverse participation ratio is 1. The comparison of 
these two extremal cases illustrates that with the help of 
the inverse participation ratio, one can tell whether only 
0(1) or as many as 0{N) components of an eigenvector 
differ significantly from 0, i.e., whether an eigenvector is 
localized or non-localized. 



B. Numerical 

1. General real symmetric eigenvalue solver 

To compute the eigenpairs of graphs below the size 
N = 5, 000, we used the general real symmetric eigen- 
value solver of Ref. |Q . This algorithm requires the al- 
location of memory space to all entries of the matrix, thus 
to compute the spectrum of a graph of size N = 20, 000 
{N = 1,000,000) using this general method with dou- 
ble precision fioating point arithmetic, one would need 
3.2 GB (8 TB) memory space and the execution of ap- 
proximately 30 = 1.2 X 10^° (3 X 10^3) floating point 
operations [^ . Consequently, we need to develop more 
efficient algorithms to investigate the properties of graphs 
with sizes comparable to real-world networks. 

2. Iterative eigenvalue solver based on the thick-restart 
Lanczos algorithm 

The spectrum of a real- world graph is the spectrum of 
a sparse real symmetric matrix, therefore the most effi- 
cient algorithms which can give a handful of the top 
eigenvalues - and the corresponding eigenvectors - of a 
large graph are iterative methods |Q. These methods 
allow the matrix to be stored in any compact format, as 
long as matrix- vector multiplication can be carried out at 
a high speed. Iterative methods use little memory: only 
the non-zero entries of the matrix and a few vectors of 
size N need to be stored. The price for computational 
speed lies in the number of the obtained eigenvalues: it- 
erative methods compute only a handful of the largest 
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(or smallest) eigenvalues of a matrix. To compute the 
eigenvalues of graphs above the size N = 5, 000, we have 
developed algorithms using a specially modified version 
of the thick-restart Lanczos algorithm |^,^ . The mod- 
ifications and some of the main technical parameters of 
our software are explained in the following paragraphs. 

Even though iterative eigenvalue methods are mostly 
used to obtain the top eigenvalues of a matrix, after mi- 
nor modifications the internal eigenvalues in the vicinity 
of a fixed A = Aq point can be computed as well. For this, 
extremely sparse matrices are usually "shift-inverted" , 
i.e., to find those eigenvalues of A that are closest to 
Ao, the highest and lowest eigenvalues of {A — XoI)~^ are 
searched for. However, because of the extremely high cost 
of matrix inversion in our case, for the computation of 
internal eigenvalues we suggest to use the "shift- square" 
method with the matrix 

B^[X*/2~{A-Xolf]^"^\ (5) 

Here A* is the largest eigenvalue of (A — Aq/)^, / is the 
identity matrix and n is a positive integer. Transforming 
the matrix A into B transforms the spectrum of A in the 
following manner. First, the spectrum is shifted to the 
left by Aq. Then, the spectrum is "folded" (and squared) 
at the origin such that all eigenvalues will be negative. 
Next, the spectrum is linearly rescaled and shifted to the 
right, with the following effect: (i) the whole spectrum 
will lie in the symmetric interval [— A*/2,A*/2] and (ii) 
those eigenvalues that were closest to Ao in the spec- 
trum of A, will be the largest now, i.e., they will be the 
eigenvalues closest to A*/2. Now, raising all eigenvalues 
to the (2n -t- l)st power increases the relative difference, 
1 — Xi/Xj, between the top eigenvalues A^ and Aj by a 
factor of 2n -I- 1. This allows the iterative method find 
the top eigenvalues of B more quickly. One can com- 
pute the corresponding eigenvalues (those being closest 
to Aq) of the original matrix, A: if 6i, &2, &nd £^re the 
normalized eigenvectors of the rid largest eigenvalues of 
B, then for A the eigenvalues closest to Aq will be - 
not necessarily in ascending order - biAbi, b2Ab2, 
bud ^ ^"d • 

The thick-restart Lanczos method uses memory space 
for the non-zero entries of the N xN large adjacency ma- 
trix, and ng + 1 vectors of length N, where ng {n^ > Ud) is 
usually between 10 and 100. Besides the relatively small 
size of required memory, we could also exploit the fact 
that the non-zero entries of a graph's adjacency matrix 
are all 1 's: during matrix- vector multiplication - which 
is usually the most time-consuming step of an iterative 
method - only additions had to be carried out instead of 
multiplications . 

The numerical spectral density functions of large 
graphs {N > 5,000) of this paper were obtained using 
the following steps. To compute the spectral density of 
the adjacency matrix. A, at an internal A = Aq location, 
first, the rid eigenvalues closest to Aq were searched for. 
Next, the distance between the smallest and the largest 



of the obtained eigenvalues was computed. Finally, p(Ao) 
this distance was multiplied by N/{nd ~ !)> 3.nd was av- 
eraged using riav different graphs. We used double pre- 
cision floating point arithmetic, and the iterations were 
stopped, if (i) at least nn iterations had been carried out 
and (ii) the lengths of the residual vectors belonging to 
the rid selected eigenpairs were all below e — 10^^^ ESI. 



IV. RESULTS 

A. Sparse uncorrelated random graphs: the 
semi-circle law is not universal 

In the uncorrelated random graph model of Erdos 
and Renyi, the total number of edges grows quadrat- 
ically with the number of vertices: N^dge = N{ki) = 
Np{N - 1) « pN'^. However, in many real-world graphs 
edges are "expensive", and the growth rate of the num- 
ber of connections remains well below this rate. For this 
reason, we also investigated the spectra of such uncor- 
related networks, for which the probability of any two 
vertices being connected changes with the size of the sys- 
tem using pN" = c = const. Two special cases are a — 
(the Erdos-Renyi model) and a = 1. In the second case, 
pN — !■ const as — > oo, i.e., the average degree remains 
constant. 

For a < 1 and N oo, there exists an infinite cluster 
of connected vertices (in fact, it exists for every a < 1 
Q). Moreover, the expectation value of any ki converges 
to infinity, thus any vertex is almost surely connected to 
the infinite cluster. The spectral density function con- 
verges to the semicircular distribution of Eq. (|l|), because 
the total weight of isolated subgraphs decreases exponen- 
tially with growing system size. (A detailed analysis of 
this issue is available in Ref. ||47|].) 

For a = 1 and iV — > cx) (see Fig.^, the probability for 
a vertex to belong to a cluster of any finite size remains 
also finite [Q. Therefore, the limiting spectral density 
contains the weig hted sum of the spectral densities of all 
finite graphs |}49| . The most striking deviation from the 
semi-circle law in this case is the elevated central part 
of the spectral density. The probability for a vertex to 
belong to an isolated cluster of size s decreases exponen- 
tially with s , therefore the number of large isolated 
clusters is low and the eigenvalues of a graph with s ver- 
tices are bounded by — Vs — 1 and ^/s — 1. For these 
two reasons, the amplitudes of delta functions decay ex- 
ponentially, as the absolute value of their locations, |A|, 
increases. 

The principal eigenvalue of this graph converges to a 
constant: lim^v— ►oo(Ai) — pN — c, and p{X) will be sym- 
metric in the N ^ oo limit. Therefore, in the limit, all 
odd moments (M2fc+i), and thus, the number of all loops 
with odd length (I?2fc-i-i) disappear. This is a salient fea- 
ture of graphs with tree structure (because on a tree every 
edge must be used an even number of times in order to 
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return to the initial vertex) , indicating that the structure 
of a sparse uncorrelated random graph becomes more and 
more tree-hke. This can also be understood by consider- 
ing that the typical distance (length of the shortest path) 
between two vertices on both a sparse uncorrelated ran- 
dom graph and a regular tree with the same number of 
edges scales as In(iV). So except for a few short-cuts a 
sparse uncorrelated random graph looks like a tree. 




X/^Np{l~p) 



FIG. 2. If — * cxj and pN = const, the spectral den- 
sity of the uncorrelated random graph does not converge to 
a semi-circle. Main panel: Symbols show the spectrum of 
an uncorrelated random graph (20, 000 vertices and 100, 000 
edges) measured with the iterative method using nav ~ 1, 
rid = 101 and rig — 250. A solid line shows the semi-circular 
distribution for comparison. (Note, that the principal eigen- 
value, Ai, is not shown here, because here at any Ao point the 
average first neighbor distance among rid = 101 eigenvalues 
was used to measure the spectral density.) Inset: Strength of 
delta functions in p(A) "caused" by isolated clusters of sizes 
1, 2 and 3 in uncorrelated random graphs (see Ref. for 
a detailed explanation). Symbols are for graphs with 20,000 
vertices and 20, 000 edges (V), 50, 000 edges (•), and 100, 000 
edges (o). Results were averaged for 3 different graphs every- 
where. 



B. The small- world graph 

1. Triangles are abundant in the graph 

For pr = 0, the small- world graph is regular and also 
periodical. Because of the highly ordered structure, p{X) 
cont ains numerous singularities, which are listed in Sec- 
tion VIA (see also Fig.^). Note that p{X) has a high 
third moment. (Remember, that we use only k > 2.) 

If we increase p^ such that the small-world region is 
reached, i.e., the periodical structure of the graph is per- 
turbed, then singularities become blurred and are trans- 
formed into high local maxima, but p(A) retains a strong 
skewness (see Fig. 0). This is in good agreement with 



results of Refs. |2^,^2l; where it has been shown that 
the local structure of the small- world graph is ordered, 
however, already a very small number of shortcuts can 
drastically change the graph's global structure. 
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FIG. 3. Spectral densities of small-world graphs using the 
complete spectra. The solid line shows the semi-circular dis- 
tribution for comparison, (a) Spectral density of the regular 
ring graph created from the small-world model with pr = 0, 
k = 10 and A'' = 1000. (b) For pr = 0.01, the average spectral 
density of small-world graphs contains sharp maxima, which 
are the "blurred" remnants of the singularities of the p^ — 
case. Topologically, this means, that the graph is still almost 
regular, but it contains a small number of impurities. In other 
words, after a small perturbation, the system is no more de- 
generate, (c) The average spectral density computed for the 
Pr = 0.3 case shows that the third moment of p(A) is pre- 
served even for very high values of pr, where there is already 
no sign of any blurred singularity (i.e., regular structure). 
This means, that even though all remaining regular islands 
have been destroyed already, triangles are still dominant, (d) 
If Pr = 1, then the spectral density of the small- world graph 
converges to a semi-circle. In figures b, c and d, 1000 different 
graphs with A'^ = 1000 and fc = 10 were used for averaging. 

In the = 1 case the small- world model becomes very 
similar to the uncorrelated random graph: the only dif- 
ference is that here, the minimum degree of any vertex 
is a positive constant, fc/2, whereas in an uncorrelated 
random graph the degree of a vertex can be any non- 
negative number. Accordingly, p{X) becomes a semi- 
circle for p^ — I (Fig. ^). Nevertheless, it should be 
noted, that as Pr converges to 1, a high value of M3 is 
preserved even for close to 1, where all local maxima 
have already vanished. The third moment of p( A) give s 
the number of triangles in the graph (see Section III A l| ); 
the lack of high local maxima - i.e., the remnants of sin- 
gularities - shows the absence of an ordered structure. 

From the above we conclude, that - from the spec- 
trum's point of view - the high number of triangles is one 
of the most basic properties of the small-world model, and 
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it is preserved much longer, than regularity or periodic- 
ity, if the level of randomness, Pr, is increased. This is in 
good agreement with the results of Ref. |5|], where the 
high number of small cycles is found to be a fundamental 
property of small- world networks. As an application, the 
high number of small cycles results in special diffusion 
properties on small- world graphs |53] . 



C. The scale- free graph 

For m = mo — 1, the scale- free graph is a tree by 
definition and its spectrum is symmetric |^^. In the 
TO > 1 case /9(A) consists of several well distinguishable 
parts (see Fig.^). The "bulk" part of the spectral den- 
sity - the set of the eigenvalues {X2, Xn} - converges 
to a symmetric continuous function which has a triangle- 
like shape for the normalized A values up to 1.5 and has 
power-law tails. 
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FIG. 4. Main panel: The average spectral densities 
of scale-free graphs with m = mo — 5, and A*" = 100 

(— ), N = 1000 (- -) and N = 7000 ( ) vertices. (For 

N = 100 and iV = 1000, the complete spectrum of 1000 
graphs, and for A*' — 7000, the complete spectrum of 25 graphs 
was used.) Another continuous line shows the semi-circular 
distribution for comparison. Observe that (i) the central 
part of the scale-free graph's spectral density is triangle-hke, 
not semi-circular and (ii) the edges show a power-law decay, 
whereas the the semi-circular distribution's edges decay expo- 
nentially, i.e., it decays exponentially at the edges |^^. Inset: 
The upper and lower tails of p(A) (open and full triangles) for 
scale-free graphs with A'^ = 40, 000 vertices the average degree 
of a vertex being (ki) = 2m = 10, as before. Note that both 
axes are logarithmic and p(A) has a power-law tail with the 
same decay rate at both ends of the spe ctrum. Here, we used 
the iterative eigenvalue solver of Section [II B 2 with ~ 21, 
7^av = 3 and Ug — 60. The line with the slope —5 in this 
figure is a guide to the eye. 

The central part of the spectral density converges to 
a triangle-like shape with its top lying well above the 



semi-circle. Since the scale-free graph is fully connected 
by definition, the increased number of eigenvalues with 
small magnitudes cannot be accounted to isolated clus- 
ters, as before. As an explanation, we suggest, that the 
eigenvectors of these eigenvalues are localized on a small 
subset of the graph's vertices. (This idea is supported by 
the high inverse participation ratios of these eigenvectors, 
see Fig.0). 



1. The spectral density of the scale-free graph decays as a 
power-law 

The inset of Fig. ^ shows the tail of the bulk part of the 
spectral density for a graph with N = 20, 000 vertices 
and 100,000 edges (i.e., pN = 10). Comparing this to 
the inset of Fig. Q - where the number of vertices and 
edges is the same as here, - one can observe the power 
law decay at the edge of the bulk part of p{X) . As shown 
later, in Section IV D, the power-law decay in this region 



is caused by eigenvectors localized on vertices with the 
highest degrees. The power law decay of the degree se- 
quence - i.e., the existence of very high degrees - is, in 
turn, due to the preferential attachment rule of the scale- 
free model. 



2. The growth rate of the principal eigenvalue shows a 
crossover in the level of correlations 



Since the adjacency matrix of a graph is a non-negative 
symmetric matrix, the graph's largest eigenvalue, Ai, is 
also the largest in magnitude (see, e.g., Theorem 0.2 of 
Ref. 1^^). Considering the effect of the adjacency matrix 
on the base vectors {bi)j = 5ij (i = 1, 2, N), it can be 
shown that a lower bound for Ai is given by the length of 
the longest row vector of the adjacency matrix, which is 
the square root of the graph's largest degree, fci. Know- 
ing that the largest degree of a scale-free graph grows as 
Vn [0, one expects Ai to grow as N^^* for large enough 
systems. 

Fig. H shows a rescaled plot of the scale-free graph's 
largest eigenvalue for different values of to. In this fig- 
ure, Ai is compared to the length of the longest row vec- 
tor, -y/fci on the "natural scale" of these values, which is 
yfm'N^^'^ [0. It is clear that if m > 1 and the system is 
small, then through several decades (a) Ai is larger than 
\fk\ and (b) the growth rate of Ai is well below the ex- 
pected rate of N^l"^. In the m = 1 case, and for large 
systems, (a) the difference between Ai and ^/k\ vanishes 
and (b) the growth rate of the principal eigenvalue will 
be maximal, too. This crossover in the behavior of the 
scale-free graph's principal eigenvalue is a specific prop- 
erty of sparse growing correlated graphs, and it is a result 
of the changing level of corre lations between the longest 
row vectors (see Section VI B). 
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3. Comparing the role of the principal eigenvalue in the 
scale-free graph and the a = 1 uncorrelated random graph: a 
comparison of structures 



Now we will compare the role of the principal eigen- 
value in the m > 1 scale-free graph and the a = 1 uncor- 
related random graph through its effect on the moments 
of the spectral density. On Figs.^ and one can ob- 
serve that (i) the principal eigenvalue of the scale-free 
graph is detached from the rest of the spectrum, a nd (ii) 
as N—^_oo, it grows as iV^/* (see also Sections [V C 2 
and VI B). The inset of Fig. || indicates, that in the 
N ^ oo limit, the bulk part will be symmetric, and its 



width will be constant (Fig. ^ rescales this constant width 
merely by another constant, namely Np[{l—p)]~^^'^) . Be- 
cause of the symmetry of the bulk part, in the N oo 
limit, the third moment of p(A) is determined exclusively 
by the contribution of the principal eigenvalue, which is 
A^~^(Ai)"^ oc N~^^^. For each moment above the third 
(e.g., for the Ith moment), with growing N, the contribu- 
tion of the bulk part to this moment will scale as 0(1), 
and the contribution of the principal eigenvalue will scale 
as N~^^^/^. In summary, in the N ^ oo limit, the scale- 
free graph's first eigenvalue has a significant contribution 
to the fourth moment; the 5th and all higher moments 
are determined exclusively by Ai: the Ith moment will 
scale as TV^i+'Z"*. 

In contrast to the above, the principal eigenvalue of the 
a — 1 uncorrelated random graph converges to the con- 
stant pN = c in the N oo limit, and the width of the 
bulk part also remains constant (see Fig. ^ . Given a fixed 
number, I, the contribution of the principal eigenvalue to 
the Ith moment of the spectral density will change as 
N~^c^ in the N ^ oo limit. The contribution of the bulk 
part will scale as 0(1), therefore all even moments of the 
spectral density will scale as 0(1) in the N oo limit, 
and all odd moments will converge to 0. 

The difference between the growth rate of the moments 
of p(A) in the above two models (scale-free graph and 
a — 1 uncorrelated random graph model) can be inter- 
preted as a sign of different structure (see Section III A 1 ) . 
In the TV — > GO limit, the average degree of a vertex 
converges to a constant in both models: limjv^oo(fci) = 
pN = c = 2m. (Both graphs will have the same number 
of edges per vertex.) On the other hand, in the limit, all 
moments of the a = 1 uncorrelated random graph's spec- 
tral density converge to a constant, whereas the moments 
Mi{l = 5,6, ...) of the scale-free graph's p{X) will diverge 
as A^— 1 -I- I /A. In other words: the number of loops of 
length I in the a = 1 uncorrelated random graph will 
grow as Di = NMi — 0{N), whereas for the scale- free 
graph for every I > 3, the number of these loops will grow 
as Di = NMi = 0(7V'/''). From this we conclude that in 
the limit, the role of loops is negligible in the a = 1 uncor- 
related random graph, whereas it is large in the scale-free 
graph. In fact, the growth rate of the number of loops in 
the scale free graph exceeds all polynomial growth rates: 



the longer the loop size (1) investigated, the higher the 
growth rate of the number of these loops {N''^^) will be. 
Note that the relative number of triangles (i.e., the third 
moment of the spectral density, Mi/N) will disappear in 
the scale- free graph, if iV ^ oo. 
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FIG. 5. Comparison of the length of the longest row 
vector, \/fc7, and the principal eigenvalue, Ai, in scale- free 
graphs. Open symbols show Ai / (y^N^^'*'), closed symbols 
show ^/ki I {y/mN^^'^). The parameter values are m — 1 (o), 
m = 2 (A), m = 4 (V) and m = 8 (o). Each data point is 
an average for 9 graphs. For the reader's convenience, data 
points are connected. 

If m > 1 and the network is small, the principal eigenvalue, 
Ai, of a scale-free graph is determined by the largest row 
vectors jointly: the largest eigenvalue is above and the 
growth rate of Ai stays below the maximum possible growth 
rate, which is Ai oc N^'''^. If m = 1, or the network is large, 
the effect of row vectors other than the longest on Ai vanishes: 
the principal eigenvalue converges to the length of the longest 
row vector, and it grows as Ai oc N^^*. Our results show a 
crossover in the growth rate of the scale-free model's principal 
eigenvalue. 

In summary, the spectrum of the scale-free model con- 
verges to a triangle-like shape in the center, and the edges 
of the bulk part decay slowly. The first eigenvalue is de- 
tached from the rest of the spectrum, and it shows an 
anomalous growth rate. Eigenvalues with large magni- 
tudes belong to eigenvectors localized on vertices with 
many neighbors. In the present context, the low number 
of triangles, the high number of loops with length above 
I ~ A, and the buildup of correlations are the basic prop- 
erties of the scale-free model. 



D. Testing the structure of a "real-world" graph 

To analyze the structure of a large sparse random graph 
(correlated or not), here we suggest several tests, that 
can be performed within 0{N) CPU time, use 0{N) 
fioating point operations, and can clearly differentiate 
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between the three "pure" types of random graph models 
treated in Section|^. Furthermore, these tests allow one 
to quantify the relation between any real-world graph and 
the three basic types of random graphs. 



1. Extremal eigenvalues 



In Section III A 2 we have already mentioned that the 
extremal eigenvalues contain useful information on the 
structure of the graph. As the spectra of uncorrelated 
random graphs (Fig.0) and scale- free networks (Fig.||) 
show, the principal eigenvalue of random graphs is often 
detached from the rest of the spectrum. For these two 
network types, the remaining bulk part of the spectrum 
- i.e., the set {A2, \n} - converges to a symmetric 
distribution, thus the quantity 



R :-- 



Ai — A2 
A, -A 



N 



(6) 



measures the distance of the first eigenvalue from the 
main part of p{\) normalized by the extension of the 
main part, (i? can be connected to the chromatic num- 
ber of the graph 
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FIG. 6. The ratio 7? — (Ai — A2)/(A2 — Ajv) for sparse 
uncorrelated random graphs small- world graphs with 

Pr = 0.01 (•) and scale- free networks (A). All graphs have an 
average degree of (fci) = 10, and at each data point, the num- 
ber of graphs used for averaging was 9. Observe, that for the 
uncorre lated r andom graph, R converges to a constant (see 
Section [II A 2), whereas it decays rapidly for the two other 
types of networks, as A 00. On the other hand, the latter 
two network types (small-world and scale-free) differ signifi- 
cantly in their magnitudes of R. 

Note, that in the N 00 limit the a = sparse un- 
correlated random graph's principal eigenvalue will scale 
as (ki), whereas both A2 and | — Aat] will scale as 2y/ (ki). 
Therefore, if (ki) > 4, the principal eigenvalue will be 
detached from the bulk part of the spectrum and R will 



scale as (\/ {h) — 2)/4. If, however, (ki) < 4, Ai will not 
be detached from the bulk part, and it will converge to 
0. 

The above explanation and Fig.^ show that in the 
(ki) > 4 sparse uncorrelated random graph model and 
the scale-free network, Ai and the rest of the spectrum 
are well separated, which gives similarly high values for 
R in small systems. In large systems, R of the sparse un- 
correlated random graph converges to a constant, while 
R in the scale-free model decays as a power law func- 
tion of N. The reason for this drop is the increasing 
denominator on the rhs. of Eq.^: A2 and Aat are the 
extremal eigenvalues in the lower and upper long tails of 
p(A), therefore, as N increases, the expectation values of 
A2 and — Aat grow as quickly as that of Ai. On the other 
hand, the small- world network shows much lower values 
of R already for small systems: here, Ai is not detached 
from the rest of the spectrum, which is a consequence of 
the almost periodical structure of the graph. 

On Fig.|^, graphs with the same number of vertices and 
edges are compared. For large {N > 10, 000) systems, for 
sparse uncorrelated random graphs R converges to a con- 
stant, whereas for scale-free graphs and small-world net- 
works it decays as a power-law. The latter two networks 
significantly differ in the magnitude of R. In summary, 
the suggested quantity R has been shown to be appropri- 
ate for distinguishing between the following graph struc- 
tures: (i) periodical or almost periodical (small- world) , 
(ii) uncorrelated non-periodical and (iii) strongly corre- 
lated non-periodical (scale-free). 



2. Inverse participation ratios of extremal eigenpairs 

Figure shows the inverse participation ratios of the 
eigenvectors of an uncorrelated random graph, a small- 
world graph with = 0.01 and a scale-free graph. Even 
though all three graphs have the same number of vertices 
(N = 1,000) and edges (5,000), one can observe rather 
specific features (see also the inset of Fig.0). 

The uncorrelated random graph's eigenvectors show 
very little difference in their level of localization, except 
for the principal eigenvector, which is much less localized 
than the other eigenvectors; /(A2) and I{Xn) are almost 
equal. For the small-world graph's eigenvectors, /(A) has 
many different plateaus and spikes; the principal eigen- 
vector is not localized, and the 2nd and A^th eigenvectors 
have high, but different /(A) values. The eigenvectors 
belonging to the scale-free graph's largest and smallest 
eigenvalues are localized on the "largest" vertices. The 
long tails of the bulk part of p(A) are due to these vertices. 
All three investigated eigenvectors (ei, 62 and e^) of the 
scale-free graph are highly localized. Consequently, the 
inverse participation ratios of the eigenvectors ei , 6*2 and 
eV are handy for the identification of the 3 basic types 
of random graph models used. 
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E. Structural variances 

1. Relative variance of the principal eigenvalue for different 
types of networks: the scale-free graph and self-similarity 

Figure^ shows the relative variance of the principal 
eigenvalue - i.e., cr(Ai)/i?(Ai) - for the three basic ran- 
dom graph types. 



0.1 



edges, one can see, that in the sparse uncorrelated ran- 
dom graph and the small-world model the relative vari- 
ance of the principal eigenvalue drops quickly with grow- 
ing system size. In the scale-free model, however, the rel- 
ative variance of the principal eigenvalue's distribution 
remains constant with an increasing number of vertices. 

In fractals, fluctuations do not disappear as the size of 
the system is increased, while in the scale-free graph, the 
relative variance of the principal eigenvalue is indepen- 
dent of system size. In this sense, the scale-free graph 
resembles self-similar systems. 
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FIG. 7. Main panel: Inverse participation ratios of 
the eigenvectors of three graphs shown as a function of the 
corresponding eigenvalues: uncorrelated random graph 
small- world graph with pr = 0.01 (•) and scale- free graph (A). 
All three graphs have A'' = 1, 000 vertices, and the average de- 
gree of a vertex is (ki) = 10. Observe, that the eigenvectors 
of the sparse uncorrelated random graph and the small-world 
network are usually non-localized (/(A) is close to 1/N). On 
the contrary, eigenvectors belonging to the scale-free graph's 
extremal eigenvalues are highly localized with 7(A) approach- 
ing 0.1. Note also, that for A ~ 0, the scale-free graph's 
7(A) has a significant "spike" indicating again the localiza- 
tion of eigenvectors. Inset: Inverse participation ratios of 
the 1st, 2nd and TVth eigenvectors of an uncorrelated ran- 
dom graph (-I-), a small- world graph with pi — 0.01 (•) and 
a scale-free graph (A). For each data point, the number 
of vertices was N = 300, 000 and the number of edges was 
1, 500, 000. Clearly, the principal eigenvector of the scale-free 
graph is localized, while the principal eigenvector of the other 
two systems (the uncorrelated models) is not. Note also, that 
the inverse participation ratios of the 2nd and Nth eigenvec- 
tors clearly differ in the small-world graph - the spectrum 
of this graph has already been shown to be strongly asym- 
metric, - whereas the inverse participation ratios of 62 and 
ejv are approximately the same in the uncorrelated random 
graph. Thus, with the help of the inverse participation ratios 
of ei, £2 and ejv, one can identify the three main types of 
random graphs used here. 

For non-sparse uncorrelated random graphs (N — > 00 
and p = const) this quantity is known to decay at a 
rate which is faster than exponential |27|j5^ ]. Compar- 
ing sparse graphs with the same number of vertices and 
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FIG. 8. Size dependence of the relative variance of the 
principal eigenvalue - i.e., cr(Ai)/7?(Ai) - for sparse uncorre- 
lated random graphs (-I-), small- world graphs with p^ = 0.01 
(•), and scale-free graphs (A). The average degree of a ver- 
tex is (ki) — 10, and 1000 graphs were used for averaging at 
every point. Observe, that in the uncorrelated random graph 
and the small-world model cr(Ai)/7J(Ai) decays with increas- 
ing system size, however, for scale-free graphs with the same 
number of edges and vertices, it remains constant. 



V. CONCLUSIONS 

We have performed a detailed analysis of the complete 
spectra, eigenvalues and the eigenvectors' inverse partic- 
ipation ratios in three types of sparse random graphs: 
the sparse uncorrelated random graph, the small-world 
model and the scale-free network. Connecting the topo- 
logical features of these graphs to algebraic quantities, 
we have demonstrated that (i) the semi-circle law is 
not universal, not even for the uncorrelated random 
graph model; (ii) the small-world graph is inherently non- 
correlated and contains a high number of triangles; (iii) 
the spectral density of the scale-free graph is made up 
of three, well distinguishable parts (center, tails of bulk, 
first eigenvalue), and as N ~* 00, triangles become neg- 
ligible and the level of correlations changes. 

We have presented practical tools for the identification 
of the above mentioned basic types of random graphs and 
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further, for the classification of real-world graphs. The 
robust eigenvector techniques and observations outlined 
in this paper combined with previous studies are likely 
to improve our understanding of large sparse correlated 
random structures. Examples for algebraic techniques 
already in use for large sparse correlated random struc- 
tures are analyses of the Internet 18| and search en- 
gines H^JI^ and mappings of the World-Wide 
Web. Besides the improvement of these techniques, the 
present work may turn out to be useful for analyzing the 
correlation structure of the transactions between a very 
high number of economical and financial units, which has 
already been started in e.g., Refs. p^-|6l[|. Lastly, we 
hope to have provided quantitative tools for the classifi- 
cation of further "real- world" networks, e.g., social and 
biological networks. 



{ei)j ~ exp 27ri 



N ) ' 



(7) 



where / = 0,2,...,A^ — 1 and i = \/— 1. The eigenvalue 
of P^"-* on ej is 



exp 2m — 
^ ' TV 



(8) 
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FIG. 9. The regular ring graph obtained from the 
small-world model in the Pr = case: rotations (p(") for 
every n = G,1,...,N — 1) are symmetry operations of the 
graph. The p'"' operators (there are A'' of them) can be used 
to create a full orthogonal basis of the adjacency matrix. A: 
taking any P'"', it commutes with A, therefore they have a 
common full orthogonal system of eigenvectors. (For a clear 
illustration of symmetries, this figure shows a graph with only 
TV = 15 vertices and A; = 4 connections per vertex.) 



VI. APPENDICES 

A. The spectrum of a small-world graph for pr = 
rewiring probability 

1. Derivation of the spectral density 

If the rewiring probability of a small-world graph is 
Pr — 0, then the graph is regular, each vertex is connected 
to its k nearest neighbors and the eigenvalues can be 
computed using the graph's symmetry operations. Rota- 
tional symmetry operations can be easily recognized, if 
the vertices of the graph are drawn along the perimeter 
of a circle (see Fig. H): let P(") (n = 0, 1, A - 1) de- 
note the symmetry operation that rotates the graph by n 
vertices in the anticlockwise direction. Being a symmetry 
operation, each p(") commutes with the adjacency ma- 
trix, A, and they have a common full orthogonal system 
of eigenvectors. 

Now, we will create a full orthogonal basis of A. (We 
will treat only the case when N is an even number; odd 
A's can be treated similarly.) It is known, that the eigen- 
values oi A are real, however, to simplify calculations, we 
will use complex numbers first. The eigenvectors of every 
P(") are ei, 6*2, ejv: 



By adding these values pairwise, one can obtain the N 
eigenvalues of the graph: 



fc/2 

A; = 2^ cos ( 27r 



(9) 



In the previous exponential form the rhs. is a summa- 
tion for a geometrical series, therefore 



sin[(fc + 1)Itt/N] 
' ~ sin(/7r/A) 

In the N oo limit, this converges to 



(10) 



sin[(fc + l)a;] 

Kx) = ^-r-. 1, (11) 

sm(a;) 

where x is evenly distributed in the interval [0,7r[. 

2. Singularities of the spectral density 

The spectral density is singular in A = X{x), if and 
only if ^{x) — 0, which is equivalent to 

(fc + 1) tan(a;) = tan[(fc + l)a;] . 



(12) 
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Since k is an even number, both this equation and 
Eq. (|l^) are invariant under the transformation x i— > 
TT — X, therefore only the xe[0, 7r/2] solutions will give 
different A values. If A; = 10 (see Fig.|), Eq. (|l|) has 
fc/2 + 1 = 6 solutions in [0,7r/2], which are x — 0, 0.410, 
0.704, 0.994, 1.28 and 7r/2. Therefore ~ according to 
Eq. ( pH ) - in the N ^ oo limit, the spectral density will 
be singular in the following points: 

Xi = -3.46, -2.19, -2, 0.043, 0.536, and fc = 10 . (13) 



B. Crossover in the growth rate of the scale- free 
graph's principal eigenvalue 

The largest eigenvalue is influenced only by the longest 
row vector if and only if the two longest row vectors are 
almost orthogonal: 



ViV2 < \vi\\V2\ 



(14) 



For TO > 1, the Ihs. of (|Tj) is the number of simul- 
taneous I's in the two longest row vectors, and the rhs. 



^ = ki, the largest degree 
, that for large j {j > i), 



can be approximated with vi 
of the graph. It is known In] 
the jth vertex will be connected to vertex i with prob- 
abihty Pij — m,/{2^/ij). Thus, we can write ( p^ in the 
following forms: 



N 



N 



or 



IniVc T 



where is the critical system size. 



(15) 



(16) 
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